Skip to content

Add fields to AzureBlob output plugin #1727

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 3 commits into from
Oct 22, 2025
Merged

Add fields to AzureBlob output plugin #1727

merged 3 commits into from
Oct 22, 2025
+216 −0

Conversation

@BHYub
Copy link
Contributor

@BHYub BHYub commented Oct 14, 2025

What this PR does / why we need it:

Add missing fields in AzureBlob output plugin
Adding these fields :

  • compressBlob
  • bufferingEnabled
  • uploadTimeout
  • uploadFileSize

Which issue(s) this PR fixes:

Fixes #1719
Not only this field but three additional fields

Does this PR introduced a user-facing change?

Having the following fields available for the AzureBlob plugin output : 
- compressBlob
- bufferingEnabled
- uploadTimeout
- uploadFileSize

Additional documentation, usage docs, etc.:

Usage:

- compressBlob : 	(on;off). Optional: Enables GZIP compression in the final blockblob file. This option isn't compatible when blob_type = appendblob.
- bufferingEnabled : (true;false).  Enable buffering into disk before ingesting into Azure Blob.
- uploadTimeout : Optional. Specify a timeout for uploads. Fluent Bit will start ingesting buffer files which have been created more than x minutes ago and haven't reached upload_file_size limit yet. Defaults to 30m.
- uploadFileSize : Specifies the size of files to be uploaded in MB. Defaults to 200M.

@BHYub BHYub force-pushed the add-fields-to-azure-blob-output-plugin branch from 18c0ba2 to c1356c2 Compare October 14, 2025 12:56
@cw-Guo
Copy link
Collaborator

cw-Guo commented Oct 20, 2025

Hi @BHYub, thanks for the contributions! can you please run make docs-update to update the documents too?

@cw-Guo cw-Guo self-requested a review October 20, 2025 05:58
@marcofranssen marcofranssen enabled auto-merge (squash) October 22, 2025 08:27
marcofranssen
marcofranssen approved these changes Oct 22, 2025
View reviewed changes
Copy link
Collaborator

@marcofranssen marcofranssen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM 🚀

Updated the docs

@marcofranssen marcofranssen merged commit e7df846 into fluent:master Oct 22, 2025
9 of 14 checks passed
joshuabaird pushed a commit to joshuabaird/fluent-operator that referenced this pull request Oct 23, 2025
@BHYub @marcofranssen @joshuabaird
Add fields to AzureBlob output plugin (fluent#1727)
dc0de93 
* Add fields to AzureBlob output plugin

Signed-off-by: BHYub <[email protected]>

* Update docs

---------

Signed-off-by: BHYub <[email protected]>
Co-authored-by: Marco Franssen <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@marcofranssen marcofranssen marcofranssen approved these changes

@cw-Guo cw-Guo Awaiting requested review from cw-Guo

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Add compressBlob field to ClusterOutput Azure Blob

3 participants

@BHYub @cw-Guo @marcofranssen